Query Optimization , Data Warehousing and Data Mining for Scientific Simulation

by Yingping Huang This thesis examines the application of infrastructure, query optimization, data warehousing and data mining technologies to the area of scientific simulation. One application of scientific simulation is on the behavior of natural organic matter (NOM). NOM is a heterogeneous mixture of organic molecules found in terrestrial and aquatic environment from forest soils and streams to coastal rivers and marshes to the open sea. NOM plays a vital role in ecological and biogeochemical processes. In this thesis, we present an agent-based stochastic simulation of NOM transformations, including biological and non-biological reactions, as well as adsorption and physical transport. It employs recent advances in web-based development environments such as J2EE, and scalable web-based database management systems such as Oracle to improve the reliability and scalability of the stochastic simulations and to facilitate analysis of the resulting large datasets. A data warehouse is built by extracting, transforming and loading data from the simulation databases. Furthermore, data mining tools and techniques are applied to the data warehouse to discover interesting knowledge. The NOM simulation system is useful in chemistry, geology and environmental science. To my wife Qiuqiu and my daughter Duoduo.